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IN THE SPECIFICATION 



Please insert the following specification paragraph in re-written "clean form". This is the first 
paragraph on the first page of the specification. 

--TECHNICAL FIELD OF THE INVENTION 

The present invention relates to the reconstruction of signals. There are many applications, 
such as radar, sonar, acoustic data, spectroscopy, geophysical, and image signal processing, in 
which it is desirable to reconstruct signals from given data. 

DESCRIPTION OF THE RELATED ART--. 

Please insert the following specification paragraph in re-written "clean form". This is the fourth 
paragraph on the first page of the specification. 

-SUMMARY OF THE INVENTION 

The present invention is directed towards improving the reconstruction of signals from 
given data so that such reconstruction can be performed within a reduced time frame.--. 

Please insert the following specification paragraph in re-written "clean form". This is the fifth 
complete paragraph on the second page of the specification. 

-DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
One example of the present invention will now be described—. 



Please add page 18 to include the following ABSTRACT OF THE DISCLOSURE: 



-ABSTRACT OF THE DISCLOSURE 
A method of reconstructing a signal from a given set of data, with a prediction function 
representing a predictable effect on the signal and a noise function representing an unpredictable 
noise. The method includes alerting a coordinate basis of the data and signal from an original 
coordinate basis in order to produce a prediction function having a reduced set of variables, 
performing a Bayesian reconstruction capable of operation of positive, negative, and complex 
signal values to produce a reconstruction signal, and converting the reconstruction signal back into 
the original coordinate basis to generate a signal.— 
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IN THE CLAIMS: 



Claim 4 is presented as follows in re-written clean format. 

-4. (Amended) A method according to claim 1 , wherein the Bayesian reconstruction 
employs a maximum entropy method- 
Claim 8 is presented as follows in re-written clean format. 

-8. (Amended) A method according to claim 1, wherein the signal to be 
reconstructed is an image signal- 
Claim 10 is presented as follows in re-written clean format. 

--10. (Amended) A method according to claim 1, wherein the signal to be 
reconstructed is a radar signal.- 

Claim 1 1 is presented as follows in re-written clean format. 

—11. (Amended) A method according to claim 1, wherein the signal to be 
reconstructed is an acoustic data signal.— 

Claim 14 is presented as follows in re- written clean format. 

-14. (Amended) A method according to claim 1, wherein the signal to be 
reconstructed is a signal from spectroscopy. — 

Claim 15 is presented as follows in re-written clean format. 

-15. (Amended) A method according to claim 1 , wherein the signal is a 
communication signal- 
Please enter the following new claim. 

-16. (Newly Added) A method according to claim 1 5, wherein the 
communication signal is a time-series signal— 



REMARKS 



Applicants request entry of the above-identified amendments which, in part, reduce 
multiple dependencies and conform the claims and specification to U.S. practice. No new matter 
is being introduced by this Amendment as antecedent support is set forth in the specification and 
the original claims. 

Entry of the amendments and prosecution on the merits is respectfully requested. 

The Examiner is invited to contact Applicants' attorneys directly by telephone at the 
below-listed telephone number with any questions, comments or concerns, or if Applicants' 
attorneys can otherwise be of any assistance. 

If there are any charges with respect to this Amendment or otherwise, please charge them 
to Deposit Account No. 06-1 130 maintained by Applicants' attorneys. 



Respectfully submitted, 



MICHAEL HOBSON, ET AL. 



CANTOR COLBURN LLP 



Applicants' Attorney 




Daniel F. Drexler 
Registration No. P47,535 
Customer No. 23413 



Date: 

Address: 

Telephone: 



March 2, 2001 

55 Griffin Road South, Bloomfield, CT 06002 
860-286-2929 



VERSION WITH MARKINGS TO SHOW CHANGES MADE 



A marked up version of the first paragraph replaced on the first page of the specification is as 
follows: 

" TECHNICAL FIELD OF THE INVENTION 

The present invention relates to the reconstruction of signals. There are many applications, 
such as radar, sonar, acoustic data, spectroscopy, geophysical, and image signal processing, in 
which it is desirable to reconstruct signals from given data. 

DESCRIPTION OF THE RELATED ART ". 

A marked up version of the fourth paragraph replaced on the first page of the specification is as 
follows: 

" SUMMARY OF THE INVENTION 

The present invention is directed towards improving the reconstruction of signals from 
given data so that such reconstruction can be performed within a reduced time frame." 

A marked up version of the fifth complete paragraph replaced on the second page of the 
specification is as follows: 

" DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
One example of the present invention will now be described." 



A marked up version of claim 4 follows: 

Claim 4 (Amended/Marked up) A method according to [any preceding] 

claim_i, wherein the Bayesian reconstruction employs [the] a maximum entropy method. 

A marked up version of claim 8 follows: 

Claim 8. (Amended/Marked up) A method according to [any of] claim[s] 1 [to 
7], [in which] wherein the signal to be reconstructed is an image signal. 

A marked up version of claim 10 follows: 

Claiml 0. (Amended/Marked up) A method according to [any of] claimfs] 1 [to 
7], [in which] wherein the signal to be reconstructed is a radar signal. 

A marked up version of claim 1 1 follows: 

Claim 1 1 . (Amended/Marked up) A method according to [any of] claim[s] 1 [to 
7], [in which] wherein the signal to be reconstructed is an acoustic data signal. 

A marked up version of claim 14 follows: 

Claim 14. (Amended/Marked up) A method according to [any of] claim[s] 1 [to 
7], [in which] wherein the signal to be reconstructed is a signal from spectroscopy. 

A marked up version of claim 15 follows: 

Claim 15, (Amended/Marked up) A method according to [any of] claim[s] 1 [to 
7], [in which] wherein the signal is a communication signal[ ? such as a time-series signal]. 
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SIGNAL PROCESSING 



The present invention relates to the reconstruction of 
signals* There are many applications, such as radar, 
sonar, acoustic data, spectroscopy, geophysical, and image 
signal processing, in which it is desirable to reconstruct 
signals from given data. 

In many of these situations the effect on the signals 
of noise and the particular characteristic of the system 
generating the signal are known or can be approximated 
using appropriate mathematical models. In these 

situations, Bayesian reconstruction methods have often been 
applied to reconstruct the signal from given data. These 
methods can work well. For example one Bayesian 
reconstruction approach, known as the maximum entropy 
method, is known to work well. Usually, the maximum 
entropy method (MEM) , is only be applied to the 
reconstruction of signals that are strictly non-negative, 
and which are not complex. Given this, it is generally not 
possible to change the basis in any vector space 
representing the data during any reconstruction. Being 
unable to do this results in computationally very expensive 
reconstruction processes having to be employed, because of 
the requirement for very large calculations having an 
extremely large number of variables to be determined. 

For example, employment of such an MEM to a stack of 
twenty images from a microscope takes in the region of 
fifty minutes using a standard INTEL™ Pentium™ 2 00MHz 
processor. 

The present invention is directed towards improving 
the reconstruction of signals from given data so that such 
reconstruction can be performed within a reduced time 
frame . 

According to the present invention there is provided 
a method of reconstructing a signal from a given set of 
data, with a prediction function representing a predictable 
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effect on the signal, and a noise function representing 
unpredictable noise, the method comprising the steps of: 

altering the coordinate basis of the data and signal 
from an original coordinate basis in order to produce a 
prediction function having a reduced set of variables; 

performing a Bayesian reconstruction capable of 
operation of positive, negative, and complex signal values 
to produce a reconstruction signal; and 

converting the reconstruction signal back into the 
original coordinate basis to generate a signal. 

The Bayesian reconstruction may be performed using a 
Fourier basis, or may use a wavelet basis. 

The Bayesian reconstruction may employ the maximum 
entropy method, in which case the method may employ an 
evaluation parameter, <x, which may be determined from a 
prior reconstruction, set at a fixed value, or determined 
during the reconstruction step. 

The signal to be reconstructed may be an image signal , 
or may be a radar, sonar, or acoustic data signal 
Alternatively, it may be a signal from spectroscopy or a 
geophysical signal . 

By employing the method of the present invention, an 
example stack of 2 0 microscope images takes approximately 

TM TM 

4 5 seconds to reconstruct using a standard INTEL Pentium 
200 MH Z processor. 

One example of the present invention will now be 
described . 
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Bayesian reconstruction methods have been applied to 
numerous problems in a wide variety of fields. In their 
standard form, however, they can be very computationally 
intensive, since they generally require the numerical 
^maximisation of a complicated function of many variables. 
For example, in image reconstruction problems, it is not 
unusual for the number of variables to be " 10 6 . 
Furthermore, one of the most popular Bayesian 
reconstruction algorithms is the maximum-entropy method 
(MEM) , which can only by applied to the reconstruction of 
signals that are strictly non-negative (see below) . The 
method can, however, be extended to signals that can take 
both positive and negative values. We develop the MEM 
approach so that it can be applied to the reconstruction of 
signals that can take positive, negative or complex values. 
As a result, this enables the use of similarity 
transformations in the reconstruction algorithm so that 
calculations can be performed in an alternative "basis" 
this is more appropriate to the problem under 
consideration. Specifically, the basis is chosen so that 
signal is reconstructed by performing a large number of 
numerical maximisations of low dimensionality, rather than 
a single maximisation of high dimensionality. This results 
in a significant increase in speed. Indeed, in the example 
outlined below, the speed of the reconstruction algorithm 
is increased by a factor of about 100. 

The standard Bayesian reconstruction techniques 
mentioned above are typically applied to a given data set 
d(y) in order to reconstruct some underlying signal s(x). 
Here, y denotes the space over which the data are defined 
and x denotes the space of the signal, which may in general 
be distinct from x and need not have the same number of 
dimensions. For example, given some data stream d(t), which 
consists of the measured values of some quantity as a 
function of time t, we may wish to reconstruct the two- 
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dimensional spatial variation of some other quantity (or 
signal) s (>:,y) . 

For most measurements it is convenient (or necessary) 
to digitise the data and the signal (for example if either 
is to be stored/analyzed on a digital computer) . We may 
therefore denote the data by the vector d with N a 
components, where N c is the number of data samples. 
Similarly, we denote the signal by the vector s of length 
N Sj where N s is the number of points at which we wish to 
reconstruct the signal. 

In general, we may express the data vector as some 
function e of the signal vector, i.e. 

d=e ( s ) 

The function e can be non-linear and specifies the effect 
of the measuring apparatus on the signal that we wish to 
reconstruct. It is customary to divide this function into 
the predictable effect of the measuring apparatus on the 
signal and the stochastic noise part due to inherent ' 
inaccuracies in the measurement process. In this case, we 
may write 

Where $ denotes the predictable response of the 
apparatus to the signal and c is a vector of length N d 
that contains any stochastic noise contributions to the 
data * 

The Bayesian approach to reconstructing the signal 

is to calculate the estimator « that maximises the 

posterior probability Pr(sd) . This is given by Bayes 1 

theorem as Pr(d[s)Pr(s) 

Fr(sid) s Pr(d) - 

where Pr(djs) is the likelihood of obtaining the 
data given the signal, Pr(s) is the prior probability, 
and the evidence Pr(d) can be considered merely as a 
normalisation constant. Thus, in order to obtain the 
(Bayesian estimator of the signal vector, we must 
maximise the product the product Pr(djs) P(s) of the 
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likelihood function and the prior. A thorough discussion 
of Bayesian analysis techniques is given by Sivia (1996) . 

The likelihood function describes the statistics of 
noise contribution € to the data. This function may 
take any form appropriate to the noise statistics. It is 
convenient to define the log-likelihood function 
L(s) = In[Pr(djs)] so that the likelihood function may be 
written as Pr(djs) = exp[L(s)]. As an example, if the 
noise on the data is Gaussian-distributed and described 
by the noise covariance matrix N, then the likelihood 
function takes the form 

Pr(d|s) a expt-|f T N- x f] 

oc exp[-|(d-^(s)) T N- i (d-^(s)}j , (2) 

where in the second line we have used (1) * In this 
case, the log-likelihood function is simply minus one 
half of the standard x 2 misfit statistic, i.e. 

L(s) = -!x 2 (s). 

The prior distribution Pr(s) codifies our knowledge 
of the underlying signal before acquiring the data. If 
we have some advance knowledge of the statistical 
properties of the signal then this is contained in the 
prior. For example, if we assume the signal to be 
described by a Gaussian random field with a covariance 
matrix C, then the prior takes the form 

Pr(s) cx exp(-^s T C" 1 s). 

Indeed, if the prior is assumed to have this form 
and the likelihood is also Gaussian, as in (2), then the 
Bayesian estimator S is obtained by maximising their 
product is identical to the standard Wiener filter 
solution. An introduction to the Wiener filter technique 
is given by Press et al (1994) . 
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It is clear, however, that although the noise 
contribution c to the data may often be Gaussian- 
distributed, the assumption of a Gaussian form for the 
prior is not valid for a general signal. If the joint 
probability distribution of the elements of the signal 
vector is known then it should be used as the prior. 
This is almost always impossible, however, and we instead 
investigate the assignment of a prior applicable to 
general signals that is based on information-theoretic 
considerations alone. Using very general notions of 
subset independence, coordinate invariance and system 
independence, it may be shown that the prior probability 
Pr(s) should take the form 

p r (s) a exp[aS(s,m)], ( 3 j 

Where the dimensional constant a « depends on the 
scaling of the problem and may be considered as a 
regularising parameter, and m is a model to which the 
Bayesian reconstruction defaults in the absence of any 
data and is usually set to a small constant value. The 
function S(s, m) is the cross-entropy of the signal and 
model vectors and is given by 

N t r 



S(«,m) = X;L-m n - Sn ln(^) 



(4 



Where N 3 , is the length of the (digitised) signal 
vector. A derivation of this result is given by Skilling 
(198 8) . By combining the entropic prior with the 
likelihood function, the Bayesian estimator of the signal 
is found by maximising with respect to s the posterior 
probability, which now takes the form 

Pr(s|d) a exp[L(s)] exp[aS(s, m)] = exp[L(s) + aS(s, m)]. 

Thus, maximising this probability distribution is 
equivalent to maximising the function 
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^(s) = L(s) -f- ctSfs, m), ( 5 ) 

and this forms the basis of the maximum entropy 
method (MEM) . 

The maximum-entropy method has been applied to a 
wide range of signal reconstruction problems. In its 
standard form, however, it can by very computationally 
intensive. The function F(s) is in general a complicated 
function of the components s n of the signal vector and so 
a numerical maximisation of the F(s) must be perform over 
this N s -dimensional space. It is not unusual for N s to 
be of the order N £ " 10 s , particularly in image 
reconstruction problems. Moreover, the standard MEM 
approach is only applicable to signals that are strictly 
non-negative, as is clear from the presence of the 
logarithmic term in the expression (4) for the entropy. 

Nevertheless, it is possible to extend the MEM 1 
so that it can be applied to the reconstruction of 
signals that can take both positive and negative values. 
The definition of the entropy for positive/negative 
signals with certain special properties was first 
presented by Gull & Shilling (1990). The generalisation 
to arbitrary positive/negative signals and the 
derivation of the prior probability in this case is given 
by Hobson & Lasenby (1998). It is found that the prior 
has the same form as given (3) but the expression for the 
entropy S(s, m) must be modified. The central idea is to 
express the general (positive/negative) signal vector s 
as the difference of two vectors u and v containing only 
strictly non-negative distributions, i.e. 

s=u-v 

By applying continuity constraints on the entropy 
functional it is possible that the expression for the 
entropy for the positive/negative signal s is given by 
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A', 

5(s, m Uj m r ) = V" <j v-V. — (m u ) r , - - s n In 



2(771^), 



I : (6) 



Where m. 0 and m v are separate models for u and v 
respectively, and where ^ n = [s 2 - + 4 (MJ n (M v ) n ] 1/2 . We 
5 cannot hope to replace the models in,, and m v by a single 
positive/negative model m s (say) , since such a 
distribution could no longer be considered as an 
integration measure. Nevertheless, we can still consider 
the difference m u - m v as the model for the signal s. We 

10 note that the form of the positive/ negative entropy 
derived by Gull & Skilling (1990) requires m u = m v . 

Given the entropic prior for general 
positive/negative signals, it is then straightforward to 
define the prior for complex signals simply by applying 

15 the above analysis to the real and imaginary parts 

separately. In this case the models M u and M v are also 
taken to be complex. The read and imaging parts of m u 
are the models for the positive portions of the real and 
imaginary parts of s respectively. Similarly, the real 

2 0 and imaginary parts of m v are the models for the negative 
portions of the real and imaginary parts of the image. 
The total entropy of the complex signal is then obtained 
by evaluating the sum (6) using first the real parts and 
then the imaginary parts of s, m u and m v and adding the 

25 results- 

The ability to reconstruct positive/negative and 
complex distributions using the MEM approach has profound 
consequences for greatly improving the both the speed and 
accuracy of the MEM technigue. These improvements are 

30 based on the idea of making a change of basis in both the 
signal and data spaces and performing a Bayesian 
reconstruction in this new basis. With an appropriate 
choice of the new bases, it is possible to speed up 
significantly the calculation of the reconstruction, 

35 which can then easily be rotated back into the original 
basis in signal space to obtain the final reconstruction 
of the signal. For example, the ability to reconstruct 
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complex signals allows us to perform reconstructions in 
the Fourier basis of complex exponentials, which greatly 
reduces the computational complexity of de-blurring 
images that have been convolved with a spatially varying 
point-spread function (see the example below) . 

In order to understand how a general change of basis 
is performed we must first remind ourselves of some basic 
results in linear algebra and vector (see e.g. Riley, 
Hobson & Bence 1997) . Suppose there exists a set of 
linearly independent vectors e tn) (n=l,.. , /N a ), that form 
a complete basis for the N s -dimensional space of the 
signal vector We may then write the signal vector as a 
weighted sum of these vectors. Formally, if we take e (n) 
to be the column vector with unity as the nth element and 
zeros elsewhere, then we may write the signal vector as 

I 

Thus we see that in order to reconstruct the signal 
vector, we are in fact reconstructuring its coefficients 
in this trivial basis. We can, however, equally well 
expand the signal vector in terms of any other linearly 
independent of set of vectors e {n) ' (n=l, . . . ,N S ) such that 

We may perform a similar procedure in the N d - 
dimensional data space, which is in general distinct from 
the signal space. If we consider the trivial basis 
vectors f (ri) (n=l,...,N d ) in this space, with unity as the 
nth elements and zeros elsewhere, then the data vector is 
given by ^ 

On performing change of basis in data space to some 
other basis f tn) ', this h^comes 
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Since the noise vector c also belongs to the data 
space a similar change of basis can apply to it, such 
that jv d jv d 

n—1 nal 

5 

It is clear that, even if the element s n of the 
signal vector in the original basis were strictly non- 
negative, the elements s' n in the new basis will in 
general take both positive and negative values. 

10 Furthermore, in the case where the new basis vectors have 
complex components, the coefficients s' n may themselves 
be complex. Hence it is the extension of the MEM 
technique to the reconstruction of such quantities that 
allows this approach to be taken. 

15 Once we have performed the changes of basis in the 

data and signal spaces, we denote the vectors with 
components s' n by s 1 and we similarly define the vectors 
d* and c f as those containing the elements d ! n and e n i i 
respectively. In the signal space we can relate the two 
20 bases e (n) and e ,(n) (n=l, . . . ,N s )by 

1=1 

where U in is the ith component of e 1 (n) with respect 
to the original (unprimed) basis. The vector s 1 and s 

2 5 are then related by 

s = Us 1 (7) 
Similar results hold for the bases f (n) and f ' {nJ 
(n = 1, ,N d ) in data space, such that 

d = Vd f (8) 

3 0 Where the element V an is the with component of f 1 , n) 

with respect to the unprimed basis. A similar expression 
exists relating the noise vectors c f and Substituting 
(7) and (8) and (1) , we then obtain 

35 d' = *'(«') + <', (9) 
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Where is a new function relating the signal and 

data vectors in the new basis. 

Clearly, our aim is to choose the new bases in the 
data and signal spaces in order that the relationship (9) 
takes the simplest form. More formally, we wish to 
perform similarity transformations in the data and signal 
spaces that partition each space into numerous (quasi-) 
disjoint subspaces of much lower dimensionality. In such 
bases, we may then calculate the estimate §< of the 
rotated signal vector by performing numerical 
maximisations in each subspace separately. Thus, we 
replace a single maximisation over the N £ -dimensional 
signal space in the original basis by numerous low- 
dimensionality maximisations over each subspace in the 
new basis. This leads to a considerable increase in the 
speed with which the reconstruction can be performed. 
Then, having calculated the Bayesian reconstruction i' 
in the new basis, the required signal reconstruction i 
can be obtained by rotating back to the original signal- 
space basis. We reiterate that, since the elements S m in 
the new basis can in general take positive, negative or 
even complex values, it is the extension of the MEM 
technique to the reconstruction of such quantities that 
allows this approach to be taken. 

As an example, let us consider the application of 
the above Bayesian reconstruction technique to the 
deconvolution of images that have been blurred by a 
spatially-invariant point-spread function (PSF) and that 
may also contain some noise contribution. For simplicity, 
we will assume that the de-blurred reconstruction is 
produced on the same pixelisation as the blurred image, 
although this is clearly not required by the technique in 
general. In this simple case, the data and signal spaces 
coincide . 

It is well known that the convolution of an 
underlying image with a spatially invariant PSF is 
equivalent to multiplying together their Fourier 
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transforms and then performing an inverse Fourier 
transform. Therefore, in the Fourier domain, each Fourier 
mode can be considered independently of the others. This 
suggests that we should perform the Bayesian 
reconstruction in the Fourier basis, such that 

With a similar expression relating the components of 
the data vectors d 1 and d and the noise vectors c and c 1 
(Since the data and signal spaces coincide). Thus, in 
this case, the N £ -dimensional signal (and data) space has 
been partitioned into N s separate disjoint spaces (i.e. 
one for each Fourier mode) . 

Now for each value of n (or Fourier mode) , we may 
consider the elements d' n , s ' n and <r; independently of 
those for other values of n. This leads to a substantial 
decrease in the CPU time required to de-blur a given 1 1 
image. For simplicity, at our chosen Fourier mode we 
denote d' n , s f n and e' n by d', s 1 and <r' respectively. 
The quantity d* is given simply by the Fourier 
coefficient of the true underlying image, or signal s 1 , 
multiplied by the Fourier coefficient of the PSF, or 
response R. In addition, a noise contribution, , in 
the Fourier domain may also be present. If is no 
instrumental errors are expected from a given apparatus, 
it is still possible to introduce "noise" by, for 
example, digitising an image in order to store it on a 
computer. Thus the data value is given by 

d 1 = Rs r + (10) 
Since we are performing the reconstruction in the 
Fourier basis, the noise on each Fourier mode will 
contain contributions from a wide range of scales. 
Therefore, provided the noise on the image is distributed 
in a statstically— homogeneous manner, we would expect 
from the central limit thereon that the noise in the 
Fourier domain is described reasonably well by a Gaussian 
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distribution. Therefore, the likelihood function is given 
by 

Pr(c?V) oc exp {-\d' - Rs'\'/a 2 ) , 

where a 2 ~ (VV)' is the variance of the noise 
contribution at the particular Fourier mode under 
consideration. From (6), the entropy S(s , / m) of this 
complex "image" may be shown to be given by (where we 
have set m u = m u = m) 



5(5, m) = Sfc(^) - 2SR(m) - 5R(s')ln 



3(V0-h3(*') 1 

20(rn) 



where the sr and ^ denote the real or imaginary part 
respectively of a complex -number; also jr(V') = {&{s f f 4*4^(m) 2 ] 1/2 
and a similar expression exists for O(^). 

Using the above expression for the likelihood and 
prior, and assuming a particular value for the 
regularising parameter a in (5) , it is then possible 1 ' 
numerically to maximise the posterior probability to 
obtain the estimator s' of the signal vector at each 
Fourier mode independently. Once these estimators have 
been calculated for all the Fourier modes, we simply 
perform an inverse Fourier transform to recover the 
de-blurred image, i.e. 

1 N ' 

s n = — ]P exp(+tVn(m - 1)/N,)s' m . 

The value of a used in the reconstruction algorithm 
may be set in three different ways. Firstly, a may be 
set such that the misfit statistic x 2 > between the 
observed data and that predicted from the reconstruction, 
is equal to its expectation value, i.e. the number of 
data points to be fitted. This choice is usually 
referred to as "historic" MEM. Alternatively , it is 
possible to determine the appropriate value for a in a 
fully Bayesian manner (Skilling 1989) by simply treating 
it as another parameter in our hypothesis space. This is 
the recommended choice and is usually referred to as 
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"classic" MEM. Finally, the simplest option is to fix 

Q in advance to some value. This option is unlikely 
to yield optimal results. It can, however, be used to 
obtain a quick solution if the historic or classic value 
for q- has already been determined for a particular 
problem on a previous occasion. 

The above technique has been applied to several 
different data sets in which an image has been convolved 
with a spatially-invariant point-spread function. For 
example, the "classic" de-blurring of a microscope image 
of a section through a pollen grain. The section has 
dimensions 128 x 128 and is taken from a three 
dimensional "stack" of 2 0 such images. The original stack 
had been blurred by a spatially invariant three 
dimensional PSF and the de-blurred reconstruction of the 
entire stack required approximately 4 5 seconds on an 
Intel Pentium 200 MH 2 processor. A standard MEM 
algorithm, which does not use the similarity i i 

transformation technique was also applied to this stack 
of images. This produced reconstructions of a similar 
quality to those obtained using the invention, but 
required approximately 50 minutes CPU time on the same 
machine. 

Similar gains in speed can be obtained by expanding 
the signal in different bases appropriate to the given 
problem, so long as the correlation matrix of the 
resulting coefficients of the data, signal and noise 
vectors in the new bases is relatively sparse. For 
example, similar results may be obtained by 
reconstructing the coefficients in a wavelet expansion 
(Daubechie 1992) of the signal as opposed to the Fourier 
expansion used above. This case has the advantage that 
the coefficients are always real. Furthermore, the 
scaling/translation properties of the wavelet transform 
allow automatic multi-resolution reconstructions of the 
signal vector. 
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Clearly, the general method outlined above can be 
applied to numerous different reconstruction problems of 
arbitrary dimensionality. Examples include the analysis 
of acoustic data, radar, underwater sonar, spectroscopy, 
geophysical data, oil exploration and medical imaging. In 
addition to spatial dimensions, additional dimensions 
such as time, spectral behavior and polarisation are also 
easily accommodated . 
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CLAIMS 

1. A method of reconstructing a signal from a given set 
of data, with a prediction function representing a 
predictable effect on the signal, and a noise function 
representing unpredictable noise, the method comprising the 
steps of ; 

altering the coordinate basis of the data and signal 
from an original coordinate basis in order to produce a 
prediction function having a reduced set of variables; 

performing a Bayesian reconstruction capable of 
operation of positive, negative, and complex signal values 
to produce a reconstruction signal; and 

converting the reconstruction signal back into the 
original coordinate basis to generate a signal. 

2. A method according to claim 1, wherein the Bayesian 
reconstruction is performed using a Fourier basis. 1 1 

3. A method according to claim 1, wherein the Bayesian 
reconstruction is performed using a wavelet basis. 

4 . A method according to any preceding claim, wherein the 
Bayesian reconstruction employs the maximum entropy method. 

5. A method according to claim 4, employing an evaluation 
parameter, ac, which is determined from a prior 
reconstruction . 

6. A method according to claim 4, employing an evaluation 
parameter, oc, which is set at a fixed value. 

7. A method according to claim 4, employing an evaluation 
parameter, oc, which is determined during the reconstruction 
step. 
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8. A method according to any of claims 1 to 7, in which 

the signal to be reconstructed is an image signal. 



9. A method according to claim 8, wherein the image 
signal is a medical image signal. 

10. A method according to any of claims 1 to 7 , in which 
the signal to be reconstructed is a radar signal. 

11. A method according to any of claims 1 to 7 , in which 
the signal to be reconstructed is an acoustic data signal. 

12. A method according to claim 11, wherein the acoustic 
data signal is an underwater sonar signal. 

13. A method according to claim 11, wherein the acoustic 
data signal is a geophysical data signal. ( ( 

14. A method according to any of claims 1 to 7 , in which' 
the signal to be reconstructed is a signal from 
spectroscopy . 

15. A method according to any one of claims 1 to 7 , in 
which the signal is a communication signal, such as a 
time-series s ignal . 
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